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ABSTRACT 

The  accuracy  of  the  discrete  reliability  growth  model  developed  by  Army  Material 
System  Analysis  Activity  (AMSAA)  is  analysed.  The  mean,  standard  deviation,  and 
95  percent  confidence  interval  of  the  estimate  of  reliabiUty  resulting  from  simulating  the 
AMSAA  discrete  reliability  growth  model  are  computed.  The  mean  of  the  estimate  of 
reliability  from  the  AMSAA  discrete  reliability  growth  model  is  compared  with  the  mean 
of  the  reliability  estimate  using  the  Exponential  discrete  reliability  growth  model  devel- 
oped at  the  Naval  Postgraduate  School  and  with  the  actual  reliability  which  was  used 
to  generate  test  data  for  the  replications  in  the  simulations.  The  testing  plan  simulated 
in  this  study  assunies  that  the  mission  tests  (go-no-go)  are  performed  until  a  predeter- 
mined number  of  failures  occur  at  which  time  a  modification  is  made.  The  main  results 
are  that  the  AMSAA  discrete  reliability  growth  model  always  performs  well  with  con- 
cave growth  patterns  and  has  difficulty  in  tracking  the  actual  reliability  which  has  con- 
vex growth  pattern  or  constant  growth  pattern  when  the  number  of  failures  specified 
equal  to  one. 
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I.     INTRODUCTION 

The  test-analyze-and-fix  scenario  is  frequently  followed  in  order  to  achieve  high  re- 
liability under  current  DOD  design  and  development  policies  during  early  development. 
An  item  will  usually  be  tested  until  it  fails.  The  failure  is  analyzed  to  determine  its 
cause,  and  what  needs  to  be  done  to  remove  the  cause  of  failure.  Appropriate  changes 
are  made  and  more  items  are  tested  until  the  next  failure  occurs.  After  each  modilica- 
tion  to  tlie  item,  it  has  a  new  reliability  and  after  the  A.''''  modiiication  we  are  m  the  K''' 
reliability  growth  phase  and  all  items  tested  in  this  phase  have  common  reliability  R^. 
This  procedure  is  repeated  several  times  until  the  requirement  for  reliability  is  achieved. 
Through  this  procedure  a  reliability  growth  pattern  is  estabhshed.  Reliability  growth 
models  have  been  developed  to  estimate  reliability  from  phase  to  phase  for  this  type  of 
test  program.  One  such  model  is  the  Army  Material  System  Analysis  Activity 
(AMSAA)  Discrete  Reliability  Growth  Model. 

The  purpose  of  this  paper  is  to  perform  an  accuracy  analysis  of  the  AMSAA  discrete 
reliability  growth  model.  Performance  evaluation  of  the  AMSAA  discrete  reliability 
growth  model  was  done  using  monte  carlo  simulation  to  generate  test  data  which  in  turn 
was  used  to  exercise  the  AMSAA  computer  program  to  compute  the  estimate  of  the 
reliability  for  each  phase.  The  reliabihty  estimates  obtained  from  the  AMSAA  model 
are  compared  with  the  actual  reliability  in  a  predetermined  sequence  of  reliabilities  which 
used  to  generate  test  data.  In  addition  these  values  are  compared  with  the  reliability 
estimate  obtained  from  the  Exponential  discrete  reUability  growth  model  which  has  been 
analyzed  at  the  Naval  Postgraduate  School  [Ref  1,  2,  and  3].  General  description  of  the 
analysis  used  in  this  paper  is  described  below  : 
For  each  phase, 

Assign  value  R, ,  the  reliability  for  /'''  phase 

Specify  F, ,  the  number  of  failures  specify  to  stop  the  phase 

Generate  A^, ,  the  number  of  tests  needed  to  obtained  F,  failures 

Collect  the  test  data,  A'  and  F, 

Compute^,,  the  estimate  of  jR, 
Rephcate  this  scenario  500  times 

Compute  the  sample  mean  R,  and  sample  standard  deviation  S^ 


1 


•  Compute  a  95%  confidence  interval  for  £  [/^,] 

•  Compare  R,  with  R,  in  graphical  form 

•  Compare  R,  with  the  estimate  of  reliability  using  the  Exponential  discrete  reliability 
erowth  model  with  the  same  data 


Prepare  appropriate  graphs. 


II.     AMSAA  DISCRETE  RELIABILITY  GROWTH  MODEL 

The  AMSAA  discrete  reliability  growth  model  [Ref.  4|  was  developed  by  L.Crow  in 
19S3  is  based  on  a  learning  curve  approach  that  had  been  mentioned  by  Duanc  [Ref. 
5].  This  model  is  applicable  when  items  under  test  are  scored  as  success  or  failure. 
The  model  is  derived  from  a  reliability  growth  model  for  continuous  data  ,  i.e.,  time  to 
failure  data.     It  is  based  on  the  Duane  reliability  growth  concepts. 


A.  INTERPRETATION  OF  LEARNING  CURVE  PROPERTY 

Let  C(t)  be  the  cumulative  failure  rate,  K(t)  be  the  total  number  of  failures  by  time 
t,  where  t  is  the  cumulative  test  time.     The  ratio  of  K(t)  and  t  is  equal  to  C(t) 

K(r) 
-7-=CU) 

Duane  observed  that  In  C(t)  was  linear  when  plotted  against  In  t 

That  is, 

In  C{[)  =  d-oi  In  [ 

Duane  expressed  this  relationship  differently  as  follows  : 

,     K(t)       .       , 
In — - —  =  d-y.  In  t 

In  — ■ —  f  =  d 

— =  gS 


let      1  -  a  =  /?  .      ;     ' 

and  let    e'^  =  ). 
K{t)  =  At" 

Consequently,  if  In  C(t)  is  a  linear  function  of  In  t,  this  implies  A'(/)  =  //^  ,  which  is  the 
learning  curve  property  for  K(t).   [Ref  4  page  1]. 


B.     AMSAA  DISCRETE  RELIABILITY  GROWTH  MODEL  DEVELOPMENT 

The  discrete  reliability  grouih  model  developed  at  AMS/V.\  uses  attributes  data. 
This  model  is  described  as  follows  ; 
;V,  =  Number  of  trials  for  configuration  / ,     i  =  ],2, ...  ,k 
T,  =  Cumulative  number  of  trials  through  configuration  / 

r,  =  .\\ 
T,  =  a;  +  .\; 

In  general : 

T,  =  .V,  +  .Y,  +  A'3  +  ...  +  ,y 

M,  =  Number  of  failures  for  configuration  i 

A'  =  Cumulative  number  of  failures  through  configuration  i 

a;  =  .\/, 

A',  =  .V/,  +  .\[, 

In  general  : 

a:,  =  .U,  +  }[,  +  .\f,  +  ...  +  M, 

£[A']  =  Expected  value  of  A",  . 

The  model  assumes  that  log  ZTfA']  is  linear  when  plotted  against  log  T, .     This  implies 
£[A;]  =  /P  .  [Ref  4  page  1  to  4]. 

£IA-]  =  ;.7T  =  /',.v, 

P  =  — - 

ElK,-]  =  A-q  =  P,.\\  +  P,N, 

p,\,  =  m-;.T^ 

In  general  : 
__/P-;.P, 


[Ref  4  page  5  to  6]. 


C.     ESTIMATION  PROCEDURE  FOR  AMSAA  DISCRETE  MODEL 

The  maximum  likelihood  estimates  /  and  /?  for  /  and  /?  were  derived  by  AMSAA  as 
follows  : 
Let. 
P,  =  Probability  of  failure  for  configuration  i 

P,  =  Estimated  failure  probability  for  configuration  i 
R,  =  Reliability  for  configuration  i 

R,  =  Estimated  reliability  for  configuration  i 
Then 

R,=  \-  P, 
where  maximum  likelihood  estimates  of/  and  /?  are  values  satisfying  : 


'[;.7;Mnr;-;.7^^_,  inr^_i]  =  o 


.^_      [/7r-/7jl,]        [A;-/7r  +  /7]l,] 
and, 


IRef.  4  page  10  to  12). 
In  this  paper  ).  and  ^  were  computed  using  the  AMSAA  computer  program. 


III.     EXPONENTIAL  DISCRETE  RELIABILITY  GROWTH  MODEL 

The  Exponential  discrete  reliability  grovnli  model  has  been  analyzed  at  the  Naval 
Postgraduate  School  in  two  theses  [Ref.  1,  2],  and  by  Corcoran  and  Read  [Rcf.  3J,  where 
Corcoran  and  Read  have  compared  several  popular  reliability  grouih  models.  This 
model  serves  as  a  model  comparison  to  the  AMSAA  discrete  reliability  growth  model. 
The  Exponential  discrete  reliability  growth  model  uses  only  attribute  data.  It  does  not 
require  any  assumption  about  the  distribution  of  the  time  to  failure.  This  model  is  de- 
scribed briefly  as  follows  : 

Let  : 

R,  =  The  reliability  of  the  component  in  phase  / 

/?,  =  I  -  exp{  -  (a  + /?/)}        where    /  =  0,1,2,... 

/  =  0    means  the  phase  prior  to  any  modification 

The  parameter  estimates  a,    and  /?,     of  a     and  /?  for  phase  /  are  computed  using  linear 

regression  methods  and  an  unbiased  estimator  for  (a  +  /?/) 

F,  =the  total  number  of  failure  during  phase  / 

A',,,  =the  number  of  tests  between  the  (/—  1)'''  failure  and/'  failure,  including  the/  , 
in  phase  / 

y=l,2,3,...,F, 

>',  =  unbiased  estimator  of  (a  +  /?/)  using/  sequence  test   in  phase  / 

An  unbiased  estimator  Y,,  for  (a  +  /?/)  [Chernoff  and  Woods  1965]  is  known  to  be  : 


y.^  =  (a  +  Pi)  = 


0  //     Nj-,=l 


for   /  =  0,1,2,...     and  ;=  1,  2,  3, ...  ,f,  . 


Since    N^^,  ,  .V^,,  >  •••    ^^f,,    are  independent  random  variables,  then 


_    (r,,+ r,,,  +  -  + r,,) 

]\  =  • '■ —     is  also  an  unbiased  estimates  lor    (a  +  />/)  . 

The  least  square  estimates  a,  and  /?,  for  a  and  /?  at  phase  /  are  : 


1  =  -^ for    /=1,   2,  3, 


=0 
/ 

and, 

a  =  }'  —  p,  i  for    /  =  1,  2,  3, ... 

where  : 

-_  (n+  r, +  -+  Y) 

{,+  [) 

,      (0+ 1 +  2  + •••  +  /) 

By  using  a,  and  /?,    the  estimate  of  reliability  for  every  phase  /  can  be  computed  as  fol- 
lows : 

y?,=  l-EXP(-(a,  +  ^,/)}  for    /=1,2,3,... 

The  estimate  of  reliability  for  the  original  version  of  the  component  R^  is  given  by  : 

R,=  l-  EXP{  -  Y,}  . 

[Ref.  6  page  3-1  to  3-3]. 

In  this  paper  the  value  of  the  mean  regression  estimate  R,  of  reliability  and  the  value 
of  standard  deviation  of  the  estimate  of  reUability  S^  were  obtained  from  a  computer 
program  used  in  J.  Chandler  thesis  [Ref  2].  The  equations  for  computing  the  reliability 
growth  values  R,  are  easily  solved  using  a  hand-held  calculator. 


IV.     MONTE  CARLO  SIMULATIONS 

Since  the  AMSAA  model  is  interested  in  the  number  of  trials  until  the  r"'  failure 
occurs,  the  Monte  Carlo  simulation  generates  random  variable  using  an  algorithms  de- 
veloped by  Fishman  197S  [Ref  7]  ,  and  a  subroutine  from  'i'he  New  Naval  Postgraduate 
School  Random  Number  Package  LLRANDOMII  19S1  [Rcf  8]  as  a  random  number 
generator  for  real  uniform  from  0  to  1.  Given/?  ,  the  probability  of  failure,  and  r,  the 
number  of  failure  lor  every  phase,  the  computer  simulation  generated  the  number  of 
trials  until  the  r'*  failure.  Specifically  let  A'  be  the  random  variable  of  interest,  the  num- 
ber of  trials  until  the  *"'■  failure,  then  X  is  called  negative  binomial  random  variable  with 
parameter  r  and/?.     The  probability  function  for  A'  is, 

^.(^•)  =  (J  Z  I  y?"'       k  =  r,r+l,r+2,...        r>0 

The  Algorithms  for  Computer  Simulation  : 
1.   let  A  and  B  be  double  precision  variables 

2.  w  =  {py 

3.  Ifr<0.    {\-p)<0,    {\-p)>\,    w<0.    w>\      go  to  9 

4.  X=r,    A  =  w,    B=w  and  6  =  {I- p){r-  [) 

5.  Generate  U,  uniform  random  number  from  0  to  1 

6.  l[L'<A    or    /I  >  0.999999    or    5  <  0.000001,     go  to  10 

7.  A'=A'+1,     B=  B{dlX+{[-p))    and    A  =  A  +  B 

8.  Go  to  4 

9.  Print  error  message  and  stop 

10.  Continue. 
[Ref  7  page  354]. 


V.     TEST  PROCEDURE 

The  AMSAA  model  is  evaluated  using  eight  dilTereiU  sets  of  reliability  values  (the 
actual  growth  pattern)  and  two  diflcrcnt  sets  of  inputs  of  number  of  failure  per  phase. 
This  gives  a  total  of  sixteen  cases.  Table  1  describes  all  16  cases.  The  set  of  reliability 
values  for  case  /  is  the  same  as  that  for  case  /  +  S  ,  /  =  1,  2,  ...  ,  8.  For  cases  1  through 
8  the  number  of  failures  per  phase  are  equal  to  one  and  for  cases  9  through  16  the 
number  of  failures  per  phase  are  equal  to  three.  The  diagram  in  Figure  1  suniniarizes 
the  simulation  procedure  and  the  consequent  analysis. 


Table  1.   ACTUAL  RELIABILITY  FOR  16  CASES 

> 

CASE  NU.VIBFRS 

1.9 

2.10 

3.11 

4,12 

5,13 

6,14 

7,15 

8,16 

1 

.600463 

.408036 

.899215 

.408036 

.408036 

.408036 

.404786 

.400000 

.600463 

.408036 

.899215 

.804273 

.804273 

.691333 

.598442 

.430000 

3 

.600463 

.408036 

.899215 

.950990 

.894416 

.804273 

.796763 

.480000 

4 

.600463 

.408036 

.899215 

.975249 

.899963 

.603542 

.796763 

.540000 

5 

.600463 

.408036 

.899215 

.990040 

.899963 

.600463 

.802460 

.610000 

6 

.600463 

.408036 

.899215 

.990040 

.899963 

.755720 

.802460 

.700000 

7 

.600463 

.408036 

.899215 

.990040 

.899963 

.849243 

.857802 

.soo(;oo 

8 

.600463 

.408036 

.899215 

.990040 

.899963 

.894416 

.902960 

.900000 

9 

.600463 

.408036 

.899215 

.990040 

.899963 

.903636 

.902960 

.950000 

10 

.600403 

.408036 

.899215 

.990040 

.899963 

.903636 

.902960 

.990000 

INPUT  DATA 

-  Number  of  fajlura  for  avary  phase  I 

-  ProtoaislOty  trf  faiJura  for  avary  phase  i 


MONTE  CAFILO  SIMULATION 
Generates  the  Negative  Binomial  R.V. 


THE  AMSAA  COMPLfTEfl  PROGRAM 

Comoutaa: 

-  The  estimate  of  rellaJaillty 

-  The  mean  of  the  estimate  of  reliability 

-  The  standard  deviation  of  the  estimate 
of  reliability 

-  95H  G  of  the  mean  of  the  estimate  of 
reliabiUtY 


THE  EXPONENTIAL  COMPUTER  PROGRAM 
Comoutas: 

-  The  mean  regression  estimate  of 
reliability 

-  The  standard  deviation  of  regression 
estimate  of  reiiabtlity 


PERFORMANCE  PLOT 

-  Rots  of  the  mean  of  the  estimate  ot 
reiiabiOty  from  both  model  and  the 
actual  reliability 

-  Rots  of  the  standard  deviation  of 
the  estimate  of  rellalDility  from  both 
model 


Figure   I.      Block  diagram  of  the  analysis 
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VI.     ANALYSIS  PROCLDURE 

A.  ACCURACY 

Figures  4  through  35  in  the  A[ic>endi\  provide  a  visual  display  of  tlie  AMSAA  dis- 
crete reliabiUtv  growth  model  accuracy  by  coinpaiing  the  gro^vth  line  for  the  AMS/\A 
with  the  actual  reliability  growth  pattern,  '['hese  graphs  also  provide  plots  for  the  ex- 
ponential discrete  reliability  growth  model  usmg  the  same  input  data  as  that  used  in  the 
AMSAA  discrete  reliability  growth  model. 

B.  VARIABILITY 

In  addition  to  the  tracking  ability  of  the  reliability  point  estimates  R,  ,  the  user  is 
also  interested  m  the  variability  of  R,.  Five  hundred  replications  were  run  tor  each  of 
the  16  cases  and  each  of  the  10  phases,  this  provided  : 


and. 


1500  _ 


^^ft,       '  499 

for    /=1.2,  ...,10    for  each  of  the  16  cases. 


The  algorithm  used  to  compute  the  mean  and  standard  deviation  is  developed  by 
Miller  1982  [Ref.  9  page  17  to  19].  Standard  deviation  of  the  reliability  estimates  from 
both  the  AMSAA  and  the  Exponential  model  are  plotted. 
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C.     CONFIDENCE  INTERVAL 

A  95%  two  sided  confidence  interval  for  £"[/^J  is  computed  for  each  model  for  all 
16  cases.     The  equation  used  for  these  confidence  limits  are  as  follows  : 


and, 

-T        (1.96)5^ 

L,.  =  R. =:^ 

V  50U 

for    /=1,2,  ....10    for  each  of  the  16  cases. 
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VII.     RESULTS  AND  CONCLUSIONS 

The  results  for  all  16  cases  can  be  seen  in  the  Appendix.  The  case  number  appears 
at  the  table  caption  or  at  the  ("igure  caption.  /Ml  of  the  results  lor  each  case  are  divided 
into  two  categories,  i.e.,  the  tabulated  statistic  and  performance  plot.  In  this  chapter 
Table  2.  Figure  2,  and  Figure  3  are  explained  as  an  example  of  the  result  from  case  1 
of  data  set. 

A.  TABULATED  STATISTICS 

Table  2  indicates  that  testing  was  done  until  one  failure  occured  after  which  a 
change  in  the  item  was  made.  The  actual  rehability  growth  values  for  each  of  the  10 
phases  was  constant  at  0.60043,  i.e.,  no  growth  actually  occured.  It  is  important  to 
simulate  this  case  in  order  to  examine  the  ability  of  the  grovnh  model  to  detect  no 
growth.  Some  reliability  growth  models  have  a  built  in  assumption  that  some  growth 
always  takes  place  after  a  design  change. 

The  values  of  R,  for  /=  I,  2, ...  ,10  are  given  in  column  4  for  the  AMSAA  model 
and  in  column  8  for  the  Exponential  model,  thus  for  phase  7,  the  A.VISAA  model  yielded 
/?,  =  0.580187    and    the    Exponential    model    yielded    a    value    of  0.525144.  The 

coresponding  values  of  the  standard  deviation  are  0.124669  and  0.261854  for  the 
AMSAA  and  the  Exponential  model  respectively. 

B.  PERrORM.\NCE  PLOT 

Figure  1  is  a  plot  of  ^,  versus  /  for  the  AMSAA  and  Exponential  models.  It  also 
displays  a  plot  of  the  actual  reliabilities  R,  .  Figure  2  is  a  plot  of  standard  deviation  for 
case  1  for  both  the  AMSAA  and  the  Exponential  model. 
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Table  2.     STATISTICS  FOR  CASE  1 


> 

INPUT 

OUTPUT  of  COMPUTER  RUN- 

DATA 

AM  S.A  A  MODEL 

E.XPONENTIAL 
MODEL 

—  2, 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  of 
RLBT 

STD 
DEV  of 

the 
EST  of 
RLBT 

95''o  CI  of  the 
MEAN  of  RLBT 

MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

.01)040  3 

.319489 

.311700 

.346811 

.292167 

.436848 

.387013 

•> 

.600463 

.485770 

.147713 

.498718 

.472823 

.459899 

.382840 

3 

.600463 

.530347 

.112104 

.540173 

.520521 

.482593 

.316476 

4 

.600463 

.553948 

.103685 

.563037 

.544860 

.515253 

.292478 

5 

.600463 

.569518 

.106661 

.578867 

.560169 

.509663 

.282941 

6 

.600463 

.580187 

.114242 

.590201 

.570173 

.514700 

.271440 

7 

.600463 

.587260 

.124669 

.598187 

.576332 

.525144 

.261854 

8 

.600463 

.592922 

.134212 

.604686 

.581158 

.529729 

.245836 

9 

.600463 

.597331 

.143335 

.609895 

.584767 

.542551 

.240164 

10 

.600463 

.600715 

.151730 

.614014 

.587415 

.550677 

.219819 
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Figure  2. 


The  reliability  growth  pattern  comparison  plot  case  1 
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STANOARO  DEVIATION 
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Figure  3.      The  standard  deviation  comparison  plot  case  1 
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C.     SUMMARY  AND  CONCLUSIONS 

To  analyze  the  test  results  for  cases  1  through  16,  all  were  divided  into  categories, 
i.e.,  constant  growih  pattern,  concave  with  rapid  growth  pattern,  concave  and  convex 
growth  pattern,  convex  growth  pattern  (see  Appendix). 

1.  Constant  Growth  Pattern 

The  AMSAA  model  didn't  track  the  actual  reliability  too  well  for  cases  1,  2.  and 
3  (the  number  of  failure  per  phase  was  set  equal  to  one).  The  AMSAA  developed  a 
concave  growth  pattern,  eventhough  in  these  cases  the  actual  reliability  was  constant. 
Furthermore  for  case  3  the  AMSAA  model  performance  became  worse  since  it  had  de- 
creasmg  pattern  and  went  below  the  actual  reliabihty  at  phase  10,  However  when  the 
number  of  failure  mcrcased  to  three,  the  AMSAA  model  tracked  the  actual  reliability 
quite  well.  The  mean  of  the  estimate  of  reliability  was  close  to  the  actual  reliability,  and 
the  standard  deviation  of  the  estimate  of  reliability  was  very  small. 

2.  Concave  nith  Rapid  Growth  Pattern 

This  type  of  actual  reliability  growth  pattern  is  represented  in  cases  4,  5,  12.  and 
13.  The  AMSAA  model  performed  well  in  tracking  actual  reliabihty  growth,  especially 
for  case  4,  case  5,  and  case  13,  where  it  is  close  to  the  actual  reliabihty  with  vei7  small 
standard  deviation  of  the  estimate  of  reUability.  For  case  12,  the  AMSAA  model  for 
some  reason  could  not  track  the  actual  reliabihty  very  well.  It  performed  almost  con- 
stant growth,  with  a  small  decrease  out  through  phase  10.  This  is  a  strange  phenomena. 
This  case  was  run  several  times  with  the  same  result. 

3.  Concave  and  Convex  Growth  Pattern 

The  AMSAA  model  has  a  problem  tracking  reliability  growth  pattern  estab- 
lished in  cases  6,  7,  14,  and  15.  The  AMSAA  model  seems  to  display  a  concave  growth 
pattern,  it  could  not  track  the  actual  reliability  which  has  a  concave  followed  by  a  con- 
vex grovah  pattern.  This  is  probably  because  the  cumulative  assumption  inherent  in 
the  AMS.AA  model  does  not  work  well  when  the  reliability  growth  has  a  convex  growth 
pattern. 
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4.  Convex  Growth  Pattern 

The  AMSAA  model  also  had  difTicuIty  in  tracking  the  actual  reliability  growth 
pattern  for  cases  8  and  16,  it  just  performed  concave  growth  pattern  for  both  cases. 
The  standard  deviation  of  the  estimate  of  reliability  was  good  in  these  cases. 

5.  Summary 

It  appears  that  the  AMSAA  discrete  reliability  growth  model  is  more  appropri- 
ate for  reliability  growth  pattern  that  has  the  following  characteristics  : 

1.  Concave  with  rapid  growth  pattern 

2.  Constant  gro\nh  pattern  with  number  of  failure  specified  more  than  one. 

It  appears  that  the  user  should  be  wary  of  using  the  AMSAA  discrete  reliability 
growth  model  when  the  actual  reliability  growlh  has  the  following  characteristics  : 

1.  Constant  growth  pattern  with  number  of  failures  specified  equal  to  one 

2.  Concave  gro\\ih  followed  by  convex  growth  pattern 

3.  Convex  growth  pattern. 

Also  the  user  should  note  that  other  discrete  reliability  growth  models  are  available 
which  for  some  growth  pattern  performed  better  than  the  AMSAA  model  and  which  can 
be  programmed  on  a  hand-held  calculator. 


17 


APPENDIX      SIMULATION  RESULTS  :  CASE  1  TO  CASE  16 


Table  3.     STATISTICS  FOR  CASE  1 


> 

INPUT 

OLTPLT  of  COMPUTER  RUN 

DATA 

AMSAA  MODEL 

EXPCJNENTIAL 
.MODEL 

—    — ! 

AC- 

IXAL 
RLBT 

MEAN 

q{  the 
EST  q{ 
RLBT 

STD 
DEV  of 

the 
EST  of 

RLBT 

95^0  CI  of  the 
MEAN  of  RLBT 

MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

.600463 

.319489 

.311700 

.346811 

.292167 

.436848 

.387013 

-) 

.600463 

.4S5770 

.147713 

.498718 

.472823 

.459899 

.382840 

3 

.600403 

.530347 

.112104 

.540173 

.520521 

.482593 

.316476 

4 

.600463 

.553948 

.103685 

.563037 

.544860 

.515253 

.292478 

5 

.600463 

.569518 

.106661 

.578867 

.560169 

.509663 

.282941 

6 

.600463 

.580187 

.114242 

.590201 

.570173 

.514700 

.271440 

7 

.600463 

.587260 

.124669 

.598187 

.576332 

.525144 

.261854 

S 

.600463 

.592922 

.134212 

.604686 

.581138 

.529729 

.245836 

9 

.600463 

.597331 

.143335 

.609895 

.584767 

.542551 

.240164 

10 

^ 

.600463 

.600715 

.151730 

.614014 

.587415 

.550677 

.219819 
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Figure  4.      The  reliability  gronth  pattern  comparison  plot  case  1 
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Figure  5.      The  standard  deviation  comparison  plot  case  1 
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TabI 

e  4. 

STATISTICS  FOR  CASE  2 

> 

INPUT 

DATA 

OUTPUT  of  COMPUTER  RUN 

AMSAA  MODEL 

EXPONENTIAL 
MODEL 

—  o^ 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  of 
RLBT 

STD 
D[:V  q{ 

the 
EST  of 
RLBT 

95°  0  CI  of  the 
MEAN  of  RLBT 

MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

.403086 

.416346 

.365885 

.448417 

.384274 

.277941 

.350039 

-> 

.403086 

.462381 

.232197 

.482733 

.442028 

.313160 

.354467 

3 

.403086 

.459150 

.173415 

.474351 

.443950 

.345541 

.294778 

4 

.403086 

.448116 

.133658 

.459831 

.436400 

.350302 

.278155 

5 

.403086 

.431723 

.109715 

.441340 

.422106 

.332342 

.274627 

6 

.403086 

.413006 

.110047 

.422652 

.403360 

.342188 

.266326 

/ 

.403086 

.394704 

.128997 

.406011 

.383397 

.340337 

.252991 

8 

.403086 

.376635 

.157304 

.390424 

.362847 

.348798 

.246473 

9 

, 

.403086 

.360838 

.186914 

.377221 

.344454 

.359013 

.239996 

10 

.403086 

.346454 

.215615 

.365353 

.327554 

.380852 

.232067 
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Figure  6.      The  reliability  growth  pattern  comparison  plot  case  2 
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Figure  7.      The  standard  deviation  comparison  plot  case  2 
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Table  5.     STATISTICS  FOR  CASE  3 


> 

CO 

INPUT 

OUTPUT  of  COMPUTER  RUN- 

DATA 

AM  SAA  MODEL 

EXPONENTIAL 
MODEL 

il 

AC- 
TUAL 
RLBT 

.MEAN 

of  the 
EST  of 
RLBT 

STD 
DEVof 

the 
EST  0^ 

RLBT 

95^0  CI  of  the 
MEAN  ot^RLBT 

MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

< 

.899215 

.397305 

.339065 

.427025 

.367585 

.784433 

.293429 

-t 

1 

.899215 

.764665 

.098591 

.773307 

.756023 

.797078 

.288337 

3 

.899215 

.839154 

.060455 

.844453 

.833855 

.822922 

.225154 

4 

.899215 

.868815 

.046403 

.872882 

.864747 

.837676 

.186795 

5 

.899215 

.885368 

.041623 

.889016 

.881719 

.834702 

.192540 

6 

.899215 

.896082 

.039685 

.899561 

.892603 

.852273 

.159859 

7 

.899215 

.903360 

.039227 

.906798 

.899921 

.858921 

.134809 

8 

.899215 

.908869 

.039064 

.913293 

.905444 

.869732 

.120620 

9 

1 

.899215 

.913205 

.038957 

.916620 

.909790 

.870845 

.119773 

10 

.899215 

.916762 

.038813 

.920164 

.913360 

.876847 

.109467 
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Figure  8.      The  reliability  growth  pattern  comparison  plot  case  3 
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Figure  9.      The  standard  deviation  comparison  plot  case  3 
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Table  6.     STATISTICS  FOR  CASE  4 


> 

V5 

INPl.T 

OUTPLT  of  COMPUTER  RUN 

DAIA 

AMSAA  MODEL 

EXPONENTIAL 
MODEL 

i? 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  or 
RLBT 

STD 
DEV  of 

the 
EST  of 
RLBf 

95%  CI  of  the 
MEAN  of  RLBT 

MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

.403086 

.247188 

.301170 

.273586 

.220789 

.277941 

.350039 

-) 

.804723 

.831764 

.062844 

.837272 

.826255 

.692599 

.334232 

3 

.9509^^0 

.923927 

.033311 

.926847 

.921007 

.900547 

.166031 

4 

.975249 

.960687 

.019283 

.962377 

.958997 

.960575 

.075075 

5 

.990040 

.978110 

.013216 

.979269 

.976952 

.985843 

.022317 

6 

.990040 

.985506 

.011104 

.986480 

.984533 

.993530 

.022859 

7 

.990040 

.988832 

.009410 

.989657 

.988007 

.993346 

.011663 

8 

.990040 

.990717 

.009306 

.991532 

.991066 

.994365 

.010904 

9 

.990040 

.991889 

.009384 

.992711 

.991066 

.994678 

.009990 

10 

.990040 

.992741 

.008820 

.993514 

.991968 

.994922 

.009867 
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Figure  10.      The  reliability  growth  pattern  comparison  plot  case  4 
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Figure  11.      The  standard  deviation  comparison  plot  case  4 
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Table  7.     STATISTICS  FOR  CASE  5 


> 

V2 

INPUT 

OUTPUT  of  COMPUTER  RUN 

DA  FA 

AMSAA  MODEL 

EXPONENTIAL 
.MODEL 

—   — = 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  oi: 
RLBT 

STD 

DEV  or 

the 
EST  of 
RLBT 

95° 0  CI  of  the 
MEAN  of  RLBT 

MEAN 

or 

RGRS 

EST 

STD 

DEV 

or 

RGRS 
EST 

UPPER 

LOWER 

1 

.403086 

.304970 

.319788 

.333001 

.276939 

.277941 

.350039 

■) 

.804723 

.716657 

.099573 

.725385 

.707929 

.692599 

.334232 

3 

.894416 

.811904 

.063882 

.817504 

.806305 

.816604 

.229131 

4 

.899963 

.854719 

.050648 

.859159 

.850280 

.857286 

.180176 

5 

.899963 

.877544 

.045115 

.881498 

.873589 

.854640 

.201203 

6 

.899963 

.891553 

.042322 

.895262 

.887843 

.852018 

.233083 

7 

.899963 

.900743 

.041174 

.904352 

.897134 

.883001 

.196564 

8 

.899963 

.907577 

.040321 

.911111 

.904042 

.880019 

.208935 

9 

.899963 

.912850 

.039735 

.916332 

.909367 

.886436 

.209224 

10 

.899963 

.917156 

.038932 

.920568 

.913743 

.889895 

.215450 
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Figure  12.      The  reliability  growth  pattern  comparison  plot  case  5 
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Figure  13.      The  standard  deviation  comparison  plot  case  5 
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Table  8.     STATISTICS  FOR  CASE  6 


> 

INPUT 

OUTPUT  of  COMPUTER  RUN- 

DATA 

AM  SAA  MODEL 

EXPONENTIAL 
MODEL 

l\ 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  of 
RLBT 

STD 
DEV  of 

the 
EST  of 
RLBT 

95° 0  CI  of  the 
.MEAN  of  RLBT 

.MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

.403086 

.224899 

.271434 

.248692 

.201107 

.277941 

.350039 

-) 

.691333 

.630239 

.101236 

.639112 

.621365 

.566627 

.371685 

3 

.804723 

.728316 

.078056 

.735158 

.721474 

.702538 

.282617 

4 

.603542 

.768103 

.070584 

.774289 

.761916 

.649254 

.242711 

5 

.600463 

.787819 

.064749 

.793495 

.782144 

.609683 

.240854 

6 

.755710 

.805681 

.061914 

.811108 

.800254 

.674674 

.217185 

7 

.849243 

.823900 

.062269 

.829358 

.818442 

.763961 

.167637 

8 

.894416 

.841536 

.063679 

.847117 

.835954 

.830485 

.122824 

9 

.903636 

.855559 

.064934 

.861250 

.849867 

.865976 

.105627 

10 

.903636 

.866080 

.064945 

.871772 

.860387 

.889152 

.084728 
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Figure  14.      The  reliability  gronlli  pattern  comparison  plot  case  6 
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Figure  15.      The  standard  deviation  comparison  plot  case  6 


29 


Table  9.     STATISTICS  FOR  CASE  7 


> 

— 

INPUT 

OUTPUT  of  COMPUTER  RUN 

DATA 

A.MSAA  .MODEL 

EXPONENTIAL 
.MODEL 

i? 

AC- 
TUAL 
RLBT 

.MEAN 
of  tlie 

EST  of 
RLBT 

SID 
DEVof 

the 
EST  of 
RLBT 

95^0  CI  of  the 
.MEAN  of  RLBT 

.MEAN 

RGRS 
EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

1 

.404786 

.304970 

.319788 

.333001 

.276939 

.262647 

.346369 

-) 

.598442 

.716657 

.099573 

.725385 

.707929 

.474285 

.378478 

.796763 

.811904 

.063882 

.817504 

.806305 

.678456 

.301077 

-4 

.796763 

.854719 

.050648 

.859159 

.850280 

.747581 

.244811 

5 

.802460 

.877544 

.045115 

.881498 

.873589 

.752545 

.242109 

6 

.802460 

.891553 

.042322 

.895262 

.887843 

.764293 

.257599 

7 

.857802 

.900743 

.041174 

.904352 

.897134 

.816030 

.237079 

8 

1 

.902960 

.907577 

.040321 

.911111 

.904042 

.842211 

.241987 

9 

.902960 

.912850 

.039735 

.916332 

.909367 

.853594 

.251411 

10 

.902960 

.917156 

.038932 

.920568 

.913743 

.855511 

.253041 
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Figure  16.      The  reliability  growth  pattern  comparison  plot  case  7 
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Figure  17.      The  standard  deviation  comparison  plot  case  7 
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Table   10. 

STATISTICS  FOR  CASE  8 

^ 
■j^. 

INPUT 
DATA 

OUTPUT  ofCOMPUTUR  RUN- 

AM  SAA  MODEL 

EXPONENTIAL 
MODEL 

5* 

—  c 

AC- 
TUAL 
RLBT 

.MEAN 

of  the 
EST  of 
RLBT 

STD 
DEVof 

the 
EST  of 

RLBT 

95%  CI  of  the 
MEAN  of  RLBT 

MEAN 

of 

RGRS 

EST 

SID 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

.400000 

.149057 

.192978 

.165972 

.132142 

.271768 

.344556 

2 

.430000 

.687404 

.080545 

.694464 

.680344 

.305861 

.350305 

3 

.480000 

.769958 

.064798 

.775638 

.764279 

.389910 

.321783 

4 

.540000 

.812713 

.056419 

.817658 

.807767 

.449303 

.284744 

5 

.610000 

.841962 

.051100 

.846441 

.837483 

.561109 

.261834 

6 

.700000 

.864439 

.047810 

.868630 

.860249 

.621144 

.238394 

7 

.800000 

.883576 

.045648 

.887577 

.879575 

.712991 

.196329 

8 

.900000 

.903105 

.043961 

.906959 

.899252 

.816562 

.138561 

9 

.950000 

.922076 

.042662 

.925816 

.918337 

.894838 

.087652 

10 

' 

.990000 

.945008 

.042874 

.948766 

.941250 

.959923 

.034246 
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Figure  18.      The  reliability  growth  pattern  comparison  plot  case  8 
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Figure  19.      The  standard  deviation  comparison  plot  case  8 
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Table   11. 

STATISTICS  FOR  CASE  9 

> 

INPUT 
D.\  f  A 

OUTPUT  of  COMPUTER  RUN 

AMSAA  MODEL 

EXPONENTIAL 
MODEL 

—  o 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  of 
RLBT 

STD 
DEV  of 

the 
EST  of 
RLBT 

95^.  CI  of  the 
MEAN  of  RLBT 

MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

3 

.600463 

.538802 

.186346 

.555136 

.522168 

.553655 

.210395 

2 

3 

.600463 

.576379 

.086393 

.583952 

.568807 

.563631 

.218474 

1 

3 

.600463 

.585866 

.063621 

.591443 

.580289 

.560046 

.196348 

4 

-> 

.600463 

.590186 

.057592 

.595234 

.585138 

.571343 

.179061 

5 

.600463 

.592796 

.058542 

.597928 

.587665 

.583947 

.154435 

6 

-% 
J 

.600463 

.594467 

.062527 

.599947 

.588986 

.586601 

.147665 

7 

-» 
J 

.600463 

.595507 

.067578 

.601431 

.589584 

.587442 

.140020 

8 

3 

.600463 

.596269 

.072753 

.602646 

.589891 

.586170 

.137124 

9 

3 

.600463 

.596791 

.077717 

.603603 

.589979 

.592676 

.123858 

10 

3 

.600463 

.596975 

.082442 

.604201 

.589749 

.589863 

.116577 
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Figure  20.      The  reliability  growth  pattern  comparison  plot  case  9 
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Figure  21. 


The  standard  deviation  comparison  plot  case  9 
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Table   12. 

STATISTICS  FOR  CASE  10 

!> 
^ 

INPUT 
DATA 

OUTPUT  of  COMPUTER  RUN- 

AM  SAA  MODEL 

EXPONENTIAL 
MODEL 

ll 

AC- 
TUAL 
RLBT 

.MEAN 

of  the 
EST  of 
RLBT 

STD 
DEV  of 

the 
EST  of 
RLBT 

95%  CI  of  the 
.MEAN  of  RLBT 

MEAN 

RGRS 
EST 

SfD 
DEV 

of 
RGRS 

EST 

UPPER 

LOWER 

1 

3 

.403086 

.365701 

.228152 

.385700 

.345703 

.348426 

.225386 

2 

•> 

.403086 

.398549 

.130351 

.409974 

.387123 

.375728 

.235090 

3 

3 

.40:;  86 

.404570 

.096573 

.413035 

.396105 

.378259 

.202326 

4 

3 

.403086 

.405363 

.077487 

.412155 

.398571 

.391223 

.180188 

5 

3 

.403086 

.404514 

.068972 

.410559 

.398468 

.400876 

.173112 

6 

3 

.403086 

.402537 

.070057 

.408678 

.396397 

.403065 

.165447 

/ 

■^ 
J 

.403086 

.399935 

.078909 

.406851 

.393018 

.399075 

.157684 

8 

.403086 

.397170 

.091792 

.405216 

.389124 

.393748 

.154780 

9 

-> 

.403086 

.394409 

.106329 

.403729 

.385089 

.400769 

.139954 

10 

3 

.403086 

.391858 

.119968 

.402374 

.381342 

.396248 

.130672 
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Figure  22.      The  reliability  growth  pattern  comparison  plot  case  10 
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Figure  23.      The  standard  deviation  comparison  plot  case  10 
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Table   13. 

STATISTICS  FOR  CASE  11 

> 

INPLT 
DATA 

OUTPUT  of  COMPUTER  RUN 

A.MSAA  .MODUL 

EXPONENTIAL 
.MODEL 

7"  "-it 

—  — ) 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  of 
RLBT 

STD 
DEV  of 

the 
EST  of 
RLBT 

Q5%  CI  of  the 
.MEAN  of  RLBT 

MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

.8992 15 

.874708 

.075400 

.881317 

.868099 

.875154 

.097891 

2 

3 

.899215 

.890215 

.030085 

.892852 

.887578 

.874634 

.108637 

-> 
:> 

.899215 

.893745 

.022208 

.895692 

.891798 

.881110 

.080530 

4 

3 

.899215 

.895290 

.019809 

.897027 

.893554 

.885150 

.071685 

5 

3 

.899215 

.896174 

.019993 

.897927 

.894422 

.887219 

.062968 

6 

3 

.899215 

.896677 

.021320 

.898545 

,894808 

.889853 

.058065 

7 

3 

.899215 

.896921 

.022891 

.898928 

.894915 

.890704 

.054956 

8 

3 

.899215 

.897091 

.024281 

.899219 

.894962 

.890799 

.051037 

9 

3 

.899215 

.897191 

.026041 

.899473 

.894908 

.893297 

.045739 

10 

3 

.899215 

.897171 

.027662 

.899596 

.894747 

.892541 

.043866 
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Figure  24.      The  reliability  growth  pattern  comparison  plot  case  1 1 
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Figure  25.      The  standard  deviation  comparison  plot  case  1 1 
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Table   14. 

STATISTICS  FOR  CASE  12 

> 

C/5 

[NPUT 
DATA 

OLTPLT  of  COMPUTER  RUN 

AMSAA  MODEL 

EXPONENTIAL 
MODEL 

—  o 

AC- 
TUAL 
RLBT 

.MEAN 

of  the 
EST  of 
RLBT 

STD 
DEV  of 

the 
EST  of 
RLBT 

95" o  CI  of  the 
MEAN  of  RLBT 

MEAN 

of 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

I 

-> 

.4030S6 

.841201 

.098829 

.849864 

.832538 

.348426 

.225386 

2 

J 

.804723 

.849013 

.046282 

.853069 

.844956 

.771284 

.162229 

3 

■^ 

_> 

.950990 

.841209 

.050197 

.845609 

.836809 

.939463 

.044327 

4 

3 

.975249 

.833962 

.078297 

.840825 

.827099 

.976039 

.017360 

5 

■1 

.990040 

.830465 

.090770 

.838422 

.822509 

.990117 

.010184 

6 

3 

.990040 

.829695 

.091803 

.837830 

.821561 

.993581 

.009200 

7 
/ 

.990040 

.828934 

.094842 

.837247 

.820620 

.994806 

.008335 

s 

3 

.990040 

.828181 

.096894 

.836674 

.819688 

.995307 

.008680 

9 

•> 

.990040 

.827444 

.098868 

.836110 

.818778 

.995613 

.008335 

10 

3 

.990040 

.826714 

.100896 

.835558 

.817870 

.995641 

.008335 
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Figure  26.      Tlie  reliability  growlh  pattern  comparison  plot  case  12 
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Figure  27.      The  standard  deviation  comparison  plot  case  12 
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Table   15. 

STATISTICS  FOR  CASE  13 

> 

INPUT 
DAI'A 

OUTPUT  of  COMPUTER  RUN 

AMSAA  MODEL 

EXPONENTIAL 
MODEL 

ia 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  q{ 
RLBT 

STD 
DEVof 

the 
EST  of 
RLBT 

95'^o  CI  of  the 
MEAN  of  RLBT 

.MEAN 

RGRS 
EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

J 

.403086 

.421329 

.242162 

.442556 

.400103 

.348426 

.225386 

t 

3 

.804723 

.751290 

.060248 

.756570 

.746009 

.771284 

.162229 

3 

.894416 

.833149 

.034031 

.836132 

.830166 

.887470 

.074325 

4 

3 

.899963 

.868939 

.026237 

.871239 

.866639 

.913950 

.052619 

5 

3 

.899963 

.887645 

.023565 

.889711 

.885580 

.921667 

.042965 

6 

3 

.899963 

.899931 

.022328 

.901348 

.897433 

.924828 

.039463 

7 

3 

.899963 

.907487 

.021942 

.909410 

.905564 

.925187 

.037596 

8 

3 

.899963 

.913555 

.021536 

.915443 

.911667 

.924395 

.035405 

9 

3 

.899963 

.918287 

.021365 

.920160 

.916414 

.925071 

.031639 

10 

3 

.899963 

.922147 

.021066 

.923994 

.920301 

.923207 

.031085 
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Figure  28.      The  reliability  growth  pattern  comparison  plot  case  13 
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Figure  29.      The  standard  deviation  comparison  plot  case  13 
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Table   16. 

STATISTICS  FOR  CASE  14 

> 

INPUT 
DATA 

OUTPUT  of  COMPUTER  RUN 

A.MSAA  MODEL 

EXPONENTIAL 
MODEL 

^s 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  of 
RLBI" 

STD 

DEV  Q^ 

ihe 
EST  of 
RLBT 

95%  CI  of  the 
.MEAN  of  RLBF 

MEAN 

RGRS 
EST 

SID 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

I 

3 

.403086 

.299748 

.196088 

.316936 

.282561 

.348426 

.225386 

-) 

3 

.691333 

.659017 

.062098 

.664460 

.653574 

.655112 

.193326 

3 

.804723 

.750623 

.043777 

.754460 

.746785 

.788019 

.117403 

4 

3 

.603542 

.787263 

.038458 

.790634 

.783892 

.713682 

.126110 

5 

h 

.600463 

.803674 

.034742 

.806720 

.800629 

.671260 

.120385 

6 

3 

.755710 

.819347 

.032614 

.822205 

.816488 

.720426 

.110446 

7 

3 

.849243 

.836709 

.032380 

.839548 

.833871 

.794972 

.084335 

8 

3 

.894416 

.853894 

.032927 

.856780 

.851008 

.851854 

.063108 

9 

3 

.903636 

.867828 

.033429 

.870758 

.864897 

.886990 

.044668 

10 

.903636 

.878133 

.033186 

.881042 

.875224 

.903086 

.038209 
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Figure  30.      The  reliability  growth  pattern  comparison  plot  case  14 
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Figure  31.      The  standard  deviation  comparison  plot  case  14 
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Table   17. 

STATISTICS  FOR  CASE  15 

> 

INPLT 
DATA 

OUTPUT  of  CO.VIPU  lER  RUN 

AMS.AA  MODHL 

EXPONENTIAL 
MODEL 

AC- 
TUAL 
RLBT 

MEAN 

of  the 
EST  of 
RLBT 

STD 

DEV  oi' 

the 
EST  of 
RLBT 

95" 0  CI  of  the 
MEAN  of  RLBT 

MEAN 

oi' 

RGRS 

EST 

STD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

3 

.404786 

.421329 

.242162 

.442556 

.400103 

.351763 

.225708 

') 

3 

.598442 

.751290 

.060248 

.756570 

.746009 

.561042 

.219588 

3 

.796763 

.833149 

.034031 

.836132 

.830166 

.761750 

.128729 

4 

.796763 

.868939 

.026237 

.871239 

.866639 

.807520 

.102913 

5 

.802460 

.887645 

.023565 

.889711 

.885580 

.828525 

.080055 

6 

, 
J 

.802460 

.899391 

.022328 

.901348 

.897433 

.836119 

.073760 

7 

.857802 

.907487 

.021942 

.909410 

.905564 

.860585 

.061728 

8 

— 
3 

.902960 

.913555 

.021536 

.915443 

.911667 

.890172 

.048793 

9 

3 

.902960 

.918287 

.021365 

.920160 

.916414 

.907881 

.037583 

10 

3 

.902960 

.922147 

.021066 

.923994 

.920301 

.915806 

.033604 
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Figure  32.      The  reliability  gronth  pattern  comparison  plot  case  15 
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Figure  33.      The  standard  deviation  comparison  plot  case  15 
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Table   18.     STATISTICS  FOR  CASE  16 


> 

INPUT 

OUTPUT  of  COMPUTER  RUN 

DATA 

A.VISAA  MODEL 

EXPONENTIAL 
MODEL 

AC- 
TUAL 
RLBT 

MEAN 

o{  the 
EST  of 
RLBF 

SID 
DEV  of 

the 
EST  of 
RLBT 

95",-  CI  of  the 
MEAN  of  RLBT 

MEAN 

of 

RG  RS 

EST 

SfD 
DEV 

of 

RGRS 

EST 

UPPER 

LOWER 

1 

•^ 

J 

.400000 

.228712 

.16(^11 

.242799 

.214625 

.344437 

.225569 

T 

3 

.430000 

.594215 

.066121 

.600011 

.588419 

.400345 

.238088 

3 

J) 

.480000 

.672784 

.053963 

.677514 

.668054 

.444004 

.202921 

4 

3 

.540000 

.716845 

.049957 

.721224 

.712466 

.506867 

.180221 

5 

3 

.610000 

.748614 

.048121 

.752832 

.744396 

.578905 

.150044 

6 

■^ 

J 

.700000 

.774650 

.047420 

.778807 

.770494 

.659072 

.127605 

7 

3 

.800000 

.798445 

.047698 

.802626 

.794264 

.746996 

.099554 

8 

3 

.900000 

.824266 

.048878 

.828550 

.819981 

.839623 

.066243 

9 

3 

.950000 

.851483 

.050970 

.855951 

.847016 

.909948 

.036966 

10 

3 

.990000 

.863599 

.051552 

.868118 

.859080 

.964163 

.016538 
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Figure  34.      The  reliability  growth  pattern  comparison  plot  case  16 
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Figure  35.      The  standard  deviation  comparison  plot  case  16 
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